Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: hollands Date: Nov 9, 2008 2:21am
Forum: forums Subject: robots.txt

a few days ago I uploaded my website with a robots.txt file with this content:
User agent: ia_archiver
Disallow: /


In my index I coded the following html meta data:



I re-forced my website www.succubi.nl here yesterday

and my website is still in the archive
what did I do wrong
how can I delete my website here??

Reply to this post
Reply [edit]

Poster: kustota Date: Nov 9, 2008 5:01am
Forum: forums Subject: Re: robots.txt

i checked and it's already gone.

Reply to this post
Reply [edit]

Poster: hollands Date: Nov 9, 2008 5:05am
Forum: forums Subject: Re: robots.txt

??
Ok, thanks
I must have looked too early

Reply to this post
Reply [edit]

Poster: kustota Date: Nov 9, 2008 8:02am
Forum: forums Subject: Re: robots.txt

no, it's still there. let's wait some more..

Reply to this post
Reply [edit]

Poster: hollands Date: Nov 9, 2008 8:42am
Forum: forums Subject: Re: robots.txt

??
strange
because I looked a few hours ago and then everything was
gone

so it's back??
Spooooky???

Reply to this post
Reply [edit]

Poster: kustota Date: Nov 9, 2008 9:01am
Forum: forums Subject: Re: robots.txt

there was some temporary glitch, it seems:
http://www.archive.org/iathreads/post-view.php?id=217006

Reply to this post
Reply [edit]

Poster: hollands Date: Nov 9, 2008 9:08am
Forum: forums Subject: Re: robots.txt

ok
but what do I do now?
Just wait??

Reply to this post
Reply [edit]

Poster: kustota Date: Nov 9, 2008 9:52am
Forum: forums Subject: Re: robots.txt

i guess so.

Terms of Use (10 Mar 2001)